A network is sparsely connected if there are relatively few links between nodes. The meaning of 'few' varies a bit between areas, for a social network if every person has a thousand connections this might seem like a lot, but in a neural network we often have fully connected layers, and so 'sparse connections' might still be numerous.
Also known as sparse connections